METHOD OF AND SYSTEM FOR DETECTING PROSPECTIVE ABNORMAL SHADOW 

This application is a continuation-in-part application 
of application Ser. No. 09/873,417 filed June 5, 2001 now 
5 abandoned. 

BACKGROUND OF THE INVENTION 
Field of the Invention 
This invention relates to a method of and a system for 
10 detecting a prospective abnormal shadow in a radiation image. 
Description of the Related Art 
Conventionally, disease or injury of a patient has been 
sometimes diagnosed by reading an X-ray film on which a 
radiation image of the patient is recorded. Recently, there 
15 has been developed a system in which a radiation image of a 
patient is once stored on a stimulable phosphor sheet (or a 
radiation image conversion panel) by exposing the stimulable 
phosphor sheet to radiation through the object (patient) to 
have the stimulable phosphor sheet store radiation energy, and 
20 stimulated emission which is emitted from each part of the 
stimulable phosphor sheet upon exposure to stimulating light 
in proportion to the radiation energy stored thereon is 
digitally read, thereby obtaining a digital image signal 
representing the radiation image stored on the stimulable 
25 phosphor sheet, and the digital image signal is reproduced as 
a visible image on a recording medium such as a photographic 
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film or on an image display system such as those using a CRT. 
(A radiation image recording and read -out apparatus: 
computed radiography, see, for instance, Japanese Unexamined 
Patent Publication Nos. 55 ( 197 5 ) - 1242 9 , 56 (1976) - 11395 and 
5 56 (1976) -11397) 

In accordance with such a radiation image recording and 
read-out apparatus, by carrying out image processing on the 
digital image signal in various ways, the tone properties and 
the frequency properties of the output visible image can be 
10 improved so that the visible image becomes more suitable for 
reading and diagnose through the visible image can be made more 
correctly . 

Further, there has been developed a system in which the 
digital image signal is analyzed by a computer to automatically 

15 detect an abnormal shadow representing a growth, a micro 
calcification or the like, whereby a certain detecting level 
can be ensured irrespective of the skillfulness of the reader. 
(Prospective abnormal shadow detecting system: see, for 
instance, Japanese Unexamined Patent Publication Nos. 

20 8 (1996) -294479 and 8 (1996) -287230) 

In this system, the degree of convergence of density 
(signal value) gradient vectors is evaluated in a digital image 
signal of a breast (a mammogram) mainly obtained by breast 
cancer examination, thereby automatically detecting a 

25 prospective growth shadow in the radiation image, or a 
prospective micro calcification shadow is automatically 
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detected by carrying out morphology operation (e.g. , dilation 
processing, erosion processing, opening processing, and 
closing processing) . The prospective abnormal shadow thus 
detected is marked with a ROI frame or the like on a visible 
5 image reproduced on a display such as of a CRT or a liquid 
crystal display or on a print. Then the display or the print 
is used for diagnosis. 

Such a prospective abnormal shadow detecting system can 
detect prospective abnormal shadows at a certain detecting 

10 level irrespective of the skillfulness of the reader and is 
very effective in suppressing overlooking prospective 
abnormal shadows. However, since the system detects the 
prospective abnormal shadow solely on the basis of the image, 
information obtained from a source other than the image, e.g. , 

15 prior information obtained from meeting with the patient, 
examination by touch, or the pas t history of the patient , cannot 
be reflected on the result of detection. For example, even 
if the doctor believes that there is a higher probability that 
the radiation image of the patient includes an abnormal shadow 

20 on the basis of the prior information, the system detects no 
abnormal shadow if there is no shadow equal to or higher than 
a preset detecting level. In such a case, the doctor (or the 
reader) interprets the result of prospective abnormal shadow 
detection and reading of the radiation image taking into 

25 account the prior information and when he still suspects that 
there should be a prospective abnormal shadow, the prospective 
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abnormal shadow detection is carried out again with the 
detecting level changed and the doctor determines whether 
there is a prospective abnormal shadow on the basis of the 
result of the second prospective abnormal shadow detection. 
5 However, when it is suspected on the basis of prior 

information that there is a prospective abnormal shadow in the 
radiation image, that prospective abnormal shadow detection 
is once carried out with the detecting level set to a normal 
level and the prospective abnormal shadow detection is carried 

10 out again with the detecting level lowered when no prospective 
abnormal shadow can be detected by the first prospective 
abnormal shadow detection is waste of time. Further, there 
is a fear that the second prospective abnormal shadow detection 
is failed and a prospective abnormal shadow is overlooked. 

15 Further, when taking a radiation image, photographing 

condi ti ons (e.g. , the tube voltage of the radiation source, 
the irradiation dose (irradiating time) , whether a grid is used, 
and the like) are sometimes set according to the object. The 
difference in the photographing conditions can vary the 

20 sensitivity of the radiation image to detection of the 
prospective abnormal shadow, which can result in difference 
in the result of detection of the prospective abnormal shadow. 
SUMMARY OF THE INVENTION 
In view of the foregoing observations and description, 

25 the primary object of the present invention is to provide a 
method of and a system for detecting a prospective abnormal 
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shadow in a radiation image in which prospective abnormal 
shadow detection is carried out taking into account conditions 
specific to the radiation image such as prior information on 
the object, the photographing conditions and the like, whereby 
5 reliability in detection of a prospective abnormal shadow is 
improved . 

Another object of the present invention is to provide 
an apparatus for detecting a prospective abnormal shadow in 
a radiation image which can detect a prospective abnormal 
10 shadow less affected by the photographing conditions of the 
radiation image. 

The method of and the system for detecting a prospective 
abnormal shadow in a radiation image in accordance with the 
present invention is characterized in that the prospective 
15 abnormal shadow detecting level is changed according to prior 
information on the object of the radiation image and or the 
photographing conditions of the radiation image. 

That is, in accordance with a first aspect of the present 
invention, there is provided a method of detecting a 
2 0 prospective abnormal shadow in an image at a predetermined 
detecting level, wherein the improvement comprises that the 
detecting level is changed according to prior information on 
the object. 

That the detecting level is changed according to prior 
25 information on the object means that the condition on the basis 
of which a part of the image is determined to be a prospective 
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abnormal shadow is relaxed so that the detection probability 
of a prospective abnormal shadow is increased at least when 
the prior information on the object is such as to indicate a 
higher probability of existence of an abnormal shadow. 
5 As the prior information, for instance, such as obtained 

from meeting with the patient, examination by touch, or the 
past history of the patient may be employed. The prior 
information obtained from meeting with the patient includes, 
for instance, age, gender, weight, habit (eating habits, 

10 sleeping hours and the like) , taste (drinking habit, smoking 
habit and the like) , work (whether the patient handles 
radiation, asbestos, or other chemicals), the symptoms of 
which the patient is conscious (e.g. , pain) , the past history 
of the patient ' s family and the like . For example, since there 

15 is a tendency that cancer (abnormal shadow) breaks out at a 
higher rate in people of higher age, the detecting level is 
changed so that the detection probability of .a prospective 
abnormal shadow is increased. Further, there is a tendency 
that the contrast of abnormal shadow is weakened as the weight 

20 of the patient increases. Accordingly, the detecting level 
is changed so that the detection probability of a prospective 
abnormal shadow is increased as the weight of the patient 
increases. In the case of cancer, which largely differs in 
the rate of outbreak according to gender, the detecting level 

25 is changed according to the gender of the patient. Further, 
when the eating habit of the patient greatly leans toward 



outbreak of tumor, when the patient drinks a lot, when the 
patient smokes, when the patient handles radiation, asbestos, 
or other chemicals in his or her work, or when the patient is 
conscious of his or her symptoms , the detecting level is changed 
5 so that the detection probability of a prospective abnormal 
shadow is increased. 

When the patient has a patient of cancer or the like in 

^ his or her family, the patient may be immunologically 

considered to be apt to suffer from the cancer and accordingly, 

^ 10 the detecting level is to be changed so that the detection 

j; probability of a prospective abnormal shadow is increased. 

= :y When the patient was treated for tumor or the like, the disease 

is apt to return. Accordingly, the detecting level is to be 
changed so that the detection probability of a prospective 

i 

W 15 abnormal shadow is increased. When an induration has been 
found through examination by touch, the detecting level is to 
be changed so that the detection probability of a prospective 
abnormal shadow is increased. 

To the contrast when the prior information on the object 
2 0 is such as to indicate a lower probability of existence of an 
abnormal shadow, the detecting level may be changed so that 
the detection probability of a prospective abnormal shadow is 
decreased. 

When the part where there is a high probability of 
25 existence of an abnormal shadow can be specified to some extent 
through, for instance, prior information obtained by 



7 



examination by touch, the detecting level may be changed only 
for a specified part of the image or may be changed part by 
part . 

Though being more useful when applied to a mammogram 
5 which is a radiation image of the breast for examination of 
breast cancer, the present invention can be applied to various 
radiation images, for instance, to a radiation image of the 
chest . 

It is preferred that the prospective abnormal shadow be 

10 basically detected by the method employed, for instance, in 
the aforesaid prospective abnormal shadow detecting system 
disclosed in Japanese Unexamined Patent Publication No. 
8 (1996) -294479) . In the prospective abnormal shadow 
detecting system, a prospective growth shadow in a radiation 

15 image is automatically detected by an iris filter processing 
in which the degree of convergence of density (signal value) 
gradient vectors is evaluated in a digital image signal 
representing the radiation image, or a prospective micro 
calcification shadow is automatically detected by carrying out 

20 morphology operation (e.g., dilation processing, erosion 
processing, opening processing, and closing processing) . In 
this system, the detecting level can be changed by changing 
a threshold value employed in evaluation of the degree of 
convergence of density gradient vectors (e.g., a threshold 

25 value Tl with which the output value I of the iris filter 
processing is compared as will be described later) , or by 



changing the values of structural elements in the morphology 
operation and a threshold value employed in evaluation of the 
degree of malignancy after the morphology operation (e.g., 
threshold values T2 , T3 and the like in formula (17) to be 
described later) . Needless to say, the prospective abnormal 
shadow may be detected by other various methods. 

As reported by Obata, et. al , of Tokyo University of 
Agriculture and Technology in "Growth Shadow Detection in a 
DR image (Iris Filter) " (Journal of Academy of 
Electronics /Information/ Communication D - II , vol. J75-D-II No. 
3, pp663 to 670, Mar. 1992), the iris filter processing has 
been studied as a method especially useful to detect a 
prospective growth shadow specific to breast cancer. However, 
the iris filter processing can be employed to detect not only 
the growth shadow in a mammogram but also other abnormal shadows 
in any radiation image so long as gradients of image signal 
components of the image signal representing the radiation 
image are converged at the abnormal shadows. 

Detection of a prospective growth shadow by the iris 
filter will be briefly described, hereinbelow. 

For example, it has been known that in a radiation image 
recorded on an X-ray film (an image represented by a high 
density, high level image signal) , a growth shadow is generally 
lower in density than surroundings, and the density 
distribution in the growth shadow is such that the density is 
higher at the periphery thereof which substantially circular 
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and lowers toward the center. That is, when a radiation image 
includes a growth shadow, a local density gradient toward the 
center of the growth is observed. 

The iris filter calculates the gradient of image signals 
5 (e.g., densities) as gradient vectors and outputs the degree 
of convergence of the gradient vectors, and in the iris filter 
processing, a prospective growth shadow is detected on the 
basis of the degree of convergence of the gradient vectors. 

In a mammogram P shown in Figure 5A, a gradient vector 

10 at a given pixel in a growth shadow PJ is directed toward the 
center of the growth shadow PJ as shown in Figure 5B. Whereas, 
gradient vectors are not directed toward a particular point 
in an elongated shadow PK such as a shadow of a blood vessel 
or a mammary gland as shown in Figure 5C. Accordingly, a 

15 prospective growth shadow can be found by evaluating 
orientations gradient vectors part by part and extracting an 
area where gradient vectors are converged on a particular 
point . 

In a shadow PL formed by a pair of elongated shadows 
20 intersecting each other as shown in Figure 5D, gradient vectors 
are apt to be directed toward a particular point and such a 
shadow can be mistaken for a prospective abnormal shadow. 
Specified steps for carrying out the algorithm will be 
described hereinbelow. 
25 (step 1) : calculation of the gradient vectors 

Orientation of the gradient vector of image data for each 
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of the pixels j of the image is calculated according to the 
following formula (1) . 

wherein f a to fi 6 are, as shown in Figure 6, values (image data) 
of pixels on the outer periphery of a 5X5 pixel mask about 
a given pixel j (pixel of current interest) . 

(step 2) : calculation of the degree of convergence of the 
gradient vectors 

Then, the degree of convergence C of the gradient vectors 
onto each of the pixels j of the image is calculated according 
to the following formula (2) . 



C = Q/N)^cosdj (2) 



wherein N represents the number of pixels in a circle with its 
center at a pixel of current interest and with a radius of R 
and 6 j represents the angle between the straight line 
connecting the pixel of current interest and each of the pixels 
j in the circle and the gradient vector for the pixel j as 
calculated according to the aforesaid formula (1) as shown in 
Figure 7 . Accordingly, the degree of convergence C as 
calculated according the aforesaid formula (2) becomes high 
when many of the orientations of the gradient vectors for the 
pixels j are directed toward the pixel of current interest. 

Since the gradient vectors for pixels near a growth 
shadow are all directed toward the center of the growth shadow 
irrespective of the contrast of the growth shadow, a pixel of 



11 



current interest which is high in the degree of convergence 
C may be considered to be a pixel at the center of the growth 
shadow. On the other hand, in a line pattern shadow such as 
of a blood vessel, gradient vectors are apt to be oriented in 
5 one direction and accordingly, the degree of convergence C does 
not become high. Accordingly, it is possible to detect a 
growth shadow by determining whether the degree of convergence 
C for each of the pixels in the image is higher than a 
predetermined threshold value. That is, this filter is less 
10 susceptible to blood vessels or mammary glands as compared with 
a normal differential filter and can effectively detect growth 
shadows . 

In actual processing, it is preferred that the size and 
shape of the filter be changed to conform to the size and shape 

15 of the growth so that growth can be detected without affected 
by the size and shape of the growth. Figure 8 shows an example 
of such a filter. In the filter shown in Figure 8, the degree 
of convergence C is evaluated on the basis of only pixels on 
radial lines extending from the pixel of current interest in 

20 M directions at regular intervals of 2 7T/M (in the example shown 
in Figure 8, in 32 directions at regular intervals of 11.25° . 

The coordinates ( [x] , [y] ) of a pixel which is in an i - th 
direction (on an i - th radial line) and an n- th pixel as numbered 
from the pixel of current interest are given by the following 

25 formulae (3) and (4) wherein (k, 1) are the coordinates of the 
pixel of current interest, and [x] and [y] are maximum integers 
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which are not larger than x and y, respectively. 
x=k+n cos{2 71 (i-1) /M} (3) 
x = l+n cos {2% (i-1) /M} (4) 

The value of outputs of the pixels from the pixel of 
5 current interest to the pixel at which the degree of convergence 
C is maximized on each of the 32 directions is taken as the 
degree of convergence C iinax in the direction, and the degrees 
of convergence C iniax in all the directions are averaged. The 
average of the degrees of convergence C ilnax in all the directions 

10 thus obtained is taken as the degree of convergence C of the 
gradient vectors for the pixel of current interest. 

Specifically, the degrees of convergence Ci( n ) are 
calculated for pixels in the range of from a pixel of current 
interest to a pixel which is in an i - th direction (on an i - th 

15 radial line) and an n-th pixel as numbered from the pixel of 
current interest is calculated according to the following 
formula (5) . 

C i{n) = t,{(co S 0 u )/n},R^<n<R mi}i (5) 

i-1 

That is, formula (5) is for calculating the degrees of 
2 0 convergence Ci{ n) for the pixels in the range of from the pixel 
of current interest to a pixel which is between the R m i n - th pixel 
and the R max -th pixel as numbered from the pixel of current 
interest on each radial line, the values of R min and R max 
respectively corresponding to a minimum radius and a maximum 
25 radius of a growth shadow to be extracted. 
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Then the degrees of convergence C of the gradient vectors 
are calculated according to the following formulae (6) and (7) . 

C ;max =maxa(n) 

C = (l/32)£c imax (7) 

5 Since the Ci max obtained from formula (6) is the maximum 

value of the degrees of convergence C i(ll ) in each direction 
obtained according to formula (5) , the area between the pixel 
of current interest and the pixel at which the degree of 
convergence Ci< n ) is maximized is a prospective growth shadow 

10 area in the direction. 

By obtaining prospective growth shadow areas in all the 
directions according to formula (6) and connecting the 
prospective growth shadow areas in adjacent directions, the 
outer shape of the overall prospective growth shadow area can 

15 be determined. 

In formula (7) , the maximum values C ima x of the degrees 
of convergence C i(n ) for the respective directions are averaged. 
The average of the maximum values Ci max of the degrees of 
convergence C i(n ) is the output I of the iris filter processing. 

20 The output I of the iris filter processing is compared with 
a threshold value Tl, and it is determined that the area having 
its center at the pixel of current interest is a prospective 
growth shadow (a prospective abnormal shadow) when the output 
I is larger than the threshold value Tl, and that the area is 
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not a prospective growth shadow when the output I is not larger 
than the threshold value Tl. 

Since the area over which the degrees of convergence C 
of the gradient vectors varies in its size and shape according 
5 to the gradient vector distribution in a similar manner to that 
in which the human iris is enlarged and contracted according 
to the ambient brightness, the method of detecting a 
prospective growth shadow using the degree of convergence of 
gradient vectors is called "iris filter processing". 
10 The degree of convergence Ci (n ) may be calculated 

according to the following formula (5') in place of the 
aforesaid formula {5) . 

C *n) 1 X>S0 ff .JUi <5') 

That is, formula (5') is for calculating the degrees of 
15 convergence Cj.( n) for the pixels in the range of from the R min -th 
pixel to a pixel which is between the R m in- th pixel and the R max - th 
pixel as numbered from the pixel of current interest on each 
radial line, the values of R min and R max respectively 
corresponding to a minimum radius and a maximum radius of a 
2 0 growth shadow to be extracted. 

According to the aforesaid steps, only growth shadows 
of a desired size can be effectively extracted. 

A malignant growth shadow generally has the following 
features in shape. 
25 1) Having an irregular edge, 
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2) Substantially circular in shape, and 

3) Uneven density distribution inside the shadow. 

In order to improve accuracy of diagnosis, a shape-based 
decision may be further carried out on the image signal 
5 representing the prospective abnormal shadow obtained through 
the comparison of the output I of the iris filter with the 
threshold value Tl, taking into account these features of a 
malignant growth shadow. Spreadness, elongation, roughness 
of the edge, circularity, uneven density distribution inside 

10 the shadow (entropy) and the like can be employed as 
characteristic values here. These characteristic values are 
compared with second threshold values T2 and it is determined 
whether the prospective abnormal shadow obtained through the 
comparison of the output I of the iris filter with the threshold 

15 value Tl is to be taken as a final prospective abnormal shadow 
on the basis of the result of the comparison. Though an 
additional processing such as the shape-based decision to be 
carried out in addition to the iris filter processing is 
strictly not the iris filter processing in itself, the iris 

20 filter processing with such an additional processing will be 
sometimes referred to as "processing based on the iris filter 
processing", hereinbelow. 

The morphology operation is a method of automatically 
detecting a prospective micro calcification shadow which is 

25 a specific form of breast cancer by the use of a multi-scale 
A and a structural element (mask) B. The morphology operation 
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is characterized in that it is effective to extract a 
calcification shadow itself, it is less susceptible to 
complicated background information and the extracted 
calcification shadow is less apt to be strained. That is, in 
5 accordance with the morphology operation, a calcification 
shadow can be detected with geometric information on the 
calcification shadow such as the size, shape and density 
distribution well preserved. The morphology operation will 
be briefly described hereinbelow. 

10 (The fundamentals of morphology operation) 

Though the morphology operation is generally developed 
as a set theory in a N- dimensional space, it will be discussed 
here on the basis of a two-dimensional tone image for the 
purpose of simplicity of understanding. 

15 It is assumed that a tone image is a space in which a 

point (x, y) has a height corresponding to a value of density 
f (x, y) . Further it is assumed that the value of density f (x, 
y) is represented by a high brightness, high level signal in 
which as the value of density decreases (the value of brightness 

2 0 increases when displayed on a CRT) , the level of the signal 
becomes higher. 

For the purpose of simplicity, a linear function f (x) 
corresponding to a cross - sec tion of the image is first 
discussed. It is assumed that a structural element g employed 

25 in the morphology operation is a function which is represented 
by the following formula (8) , is symmetrical about the origin, 
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and is 0 in value in a domain represented by the following 
formula (9) . 
g s (x)=g(-x) (8) 

G={-m, -m + 1, -1, 0, 1, m-1, m) (9) 

5 At this time, the fundamental form of the morphology operation 
is very simple as shown in the following formulae (10) to (13) . 
dilation : [f G s ] (i) =max {f (i-m) , ••• , f (i) , — , f (i+m) } — (10) 
erosion : [f G s ] (i) =min {f (i-m) , — , f (i) , ••• , f (i+m) } - •• (11) 
opening : f s = (f g s ) g (12) 

10 closing : f s = (f g s ) g (13) 

That is, the dilation processing is processing for 
searching a maximum value in the area whose width is +m (a 
value determined according to the structural element B) and 
whose center is at the pixel of current interest, see Figure 

15 9A, and the erosion processing is processing for searching a 
minimum value in the same area, see Figure 9B . The opening 
processing corresponds to searching a maximum value after 
searching a minimum value, and the closing processing 
corresponds to searching a minimum value after searching a 

20 maximum value. In other words, the opening processing 
smoothens the density curve f (x) from the low brightness side 
by removing protrusions in density (the portions which are 
higher in brightness than the surroundings) which are narrower 
than the mask size 2m (see Figure 9C) , whereas the closing 

25 processing smoothens the density curve f (x) from the high 
brightness side by removing recesses in density (the portions 
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which are lower in brightness than the surroundings) which are 
narrower than the mask size 2m (see Figure 9D) . 

In the case of a high density, high level signal in which 
as the value of density increases, the level of the signal 
5 becomes higher, the value of image signal for the value of 
density f (x) is reverse to that of a high brightness, high level 
signal. Accordingly, the dilation processing for a high 
density, high level signal corresponds to the erosion 
processing for a high brightness, high level signal. 

10 Similarly, the erosion processing for a high density, high 
level signal corresponds to the dilation processing for a high 
brightness, high level signal, the opening processing for a 
high density, high level signal corresponds to the closing 
processing for a high brightness, high level signal, and the 

15 closing processing for a high density, high level signal 
corresponds to the opening processing for a high brightness, 
high level signal. Description will be made only on the high 
brightness, high level signal here. 

(Application to detection of a calcification shadow) 
20 As a method of detecting a calcification shadow, a 

subtraction method in which a smoothened image is subtracted 
from an original image is conceivable. Since it is difficult 
to distinguish a calcification shadow from an elongated 
non - calcification shadow (e.g., of a mammary gland, a blood 
25 vessel, and a mammary gland supporting tissue) by a simple 
smoothening method, Obata, et al, have proposed morphology 
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operation processing based on opening operation using multiple 
structural elements as represented by the following formula 
(14) . See "Extraction of Micro Calcification Shadow by a 
Morphology Filter using multiple Structural Elements" 
5 (Journal of Academy of Electronics/Information/Communication 
D-II, vol. J75-D-II No. 7, ppll70 to 1176, Jul. 1992) and 
"Fundamentals of Morphology and its Application to Mammogram" 
(MEDICAL IMAGING TECHNOLOGY, Vol. 12, No . 1 January 1994) 
P=f-max{(f0B i )0B i } 

I G CI . M) 

10 (14) 

=f-max {f a i } 

wherein Bi (i stands for 1, 2, 3 and 4) are four linear 
structural elements B shown in Figure 10. When the structural 
elements B are larger than the calcification shadow to be 

15 detected, calcification shadows which are signal protrusions 
narrower than the structural elements B (a part of image the 
image signal of which fluctuates in a range spatially narrower 
than the structural elements B) are removed by opening 
processing. On the other hand , an elongated non - calcification 

20 shadow is left there as it is after the opening processing 
(calculation of the second term in formula 14) so long as it 
is longer than the structural elements B and its inclination 
(the direction in which the shadow extends) conforms to any 
one of the four structural elements B± . Accordingly, by 

25 subtracting the smoothened image (the image removed with the 
calcification shadow) obtained by the opening processing from 



20 



the original image an image containing therein only a small 
prospective calcification shadow is obtained. This the 
concept of formula (14) . 

In the case of a high density, high level signal, closing 
5 processing is applied according to the following formula (15) 
in place of opening processing. 

P^f-mmKfSBOeBi} 

(15) 

=f-min{f Bi } 

16(1. -, M) 

10 However, a non- calcification shadow equivalent to a 

calcification shadow in size can remain. In such a case, 
non - calci f ication shadows contained in P of formula (14) are 
further removed by the use of differential information based 
on a morphology operation according to the following formula 

15 (16) . 

M grad = (1/2) X {f A B- f AB} (16) 

As the value of M grad increases, the probability that the shadow 
is of a calcification increases. Accordingly, a prospective 
calcification shadow C s can be obtained according to the 

20 following formula (17) . 

If P(i, j)^T2, and M grad (i, j) ^T3 

Then, C s (i, j)=P else C s (i, j)=0 (17) 

T2 and T3 are empirically determined threshold values. 

Since a non- calcification shadow different from a 

25 calcification shadow in size can be removed only by comparison 
of P obtained according to formula (14) and the threshold value 
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T2 , only the condition of the first term of formula (17) , P(i, 
j) =^T2 has to be satisfied in the case where there is no 
possibility that a non- calcification shadow equivalent to a 
calcification shadow in size remains. 
5 Also in the morphology operation, an additional 

processing such as the shape-based decision described above 
in conjunction with the iris filter processing may be carried 
out in addition to the morphology operation. Also in this case, 
the morphology operation with such an additional processing 

10 will be sometimes referred to as "processing based on the 
morphology operation", hereinbelow. 

In accordance with a second aspect of the present 
invention, there is provided a method of detecting a 
prospective abnormal shadow in an image of an object at a 

15 predetermined detecting level, wherein the improvement 
comprises that the detecting level is changed according to 
photographing conditions under which the image of the object 
is taken. 

The detecting level may be changed in the same manner 
20 as in the method of the first aspect of the present invention. 

As is well known, the quality of image varies according 
to the photographing conditions. For example, in a radiation 
image obtained by a smaller irradiation dose, a structure which 
is high in spatial frequency (e.g., a micro calcification 
25 shadow) is less apt to be detected than in a radiation image 
obtained by a larger irradiation dose. Accordingly, the 
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prospective abnormal shadow detecting level varies according 
to the photographing conditions. That the detecting level is 
changed according the photographing conditions means that the 
condition on the basis of which a part of the image is determined 
5 to be a prospective abnormal shadow is relaxed so that the 
detection probability of a prospective abnormal shadow is 
increased when the photographing conditions are such as to 
lower the probability of existence of an abnormal shadow. 
Similarly, the detecting level may be changed so that the 

10 detection probability of a prospective abnormal shadow is 
decreased when the photographing conditions are such as to 
increase the probability of existence of an abnormal shadow. 

The photographing conditions include the tube voltage 
and the tube current of the radiation source, the irradiating 

15 time, the product of the tube current and the irradiating time 
(the mAs value) , the degree of compression of the object when 
the object is photographed under pressure (especially when the 
object is the breast, the pressure on the breast or the 
thickness to which the breast is compressed) , whether a grid 

20 for preventing scattering is used, the kind of the grid used, 
the magnifying power and the like. 

In accordance with a third aspect of the present 
invention, there is provided a system for carrying out the 
method of detecting a prospective abnormal shadow in a 

25 radiation image in accordance with the first aspect of the 
present invention. That is, in accordance with the third 
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aspect of the present invention, there is provided a system 
for detecting a prospective abnormal shadow in an image of an 
object comprising a prospective abnormal shadow detecting 
means which detects a prospective abnormal shadow at a 
5 predetermined detecting level, wherein the improvement 
comprises that 

there are provided a prior information input means 
through which prior information on the object is input, and 
a detecting level changing means which changes the detecting 

10 level according to the prior information on the object input 
through the prior information input means, and 

that the prospective abnormal shadow detecting means 
detects a prospective abnormal shadow according to the 
detecting level changed by the detecting level changing means . 

15 In accordance with a fourth aspect of the present 

invention, there is provided a system for carrying out the 
method of detecting a prospective abnormal shadow in a 
radiation image in accordance with the second aspect of the 
present invention. That is, in accordance with the fourth 

20 aspect of the present invention, there is provided a system 
for detecting a prospective abnormal shadow in an image of an 
object comprising a prospective abnormal shadow detecting 
means which detects a prospective abnormal shadow at a 
predetermined detecting level, wherein the improvement 

25 comprises that 

there are provided a photographing condition input means 
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through which photographing conditions under which the image 
of the object is taken is input, and a detecting level changing 
means which changes the detecting level according to the 
photographing conditions input through the photographing 
5 condition input means, and 

that the prospective abnormal shadow detecting means 
detects a prospective abnormal shadow according to the 
detecting level changed by the detecting level changing means. 

It is preferred that the detecting level changing means 
10 changes the detecting level part by part. In this case, it 
is natural for the prospective abnormal shadow detecting means 
to detect a prospective abnormal shadow according to the 
detecting level changed by the detecting level changing means 
part by part. 

15 In accordance with a fifth aspect of the present 

invention, there is provided an apparatus for detecting a 
prospective abnormal shadow in a radiation image of an object 
comprising 

a photographing condition input means through which 
2 0 photographing conditions under which the radiation image of 
the object is taken is input, and 

a prospective abnormal shadow detecting means which 
detects a prospective abnormal shadow on the basis of the 
photographing conditions input through the photographing 
25 condition input means and radiation image data representing 
the radiation image of the object. 
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The photographing conditions are conditions which can 
affect the quality of the radiation image and the like and 
include the kind of the grid employed in photographing, the 
tube voltage of the radiation source, the kind of the filter 
5 for controlling the quality of radiation to which the object 
is exposed, the irradiating time, the pressure on the breast 
and/or the thickness to which the breast is compressed (when 
the object is the breast and the breast is photographed under 
pressure), and the like. 

10 The kind of the grid employed in photographing means the 

kind of the grid mounted on the X-ray apparatus, and may be 
divided, for instance, by material of the grid or the number 
of grid lines. That is, the kind of the grid may be divided 
by a feature which will affect the contrast of recorded images. 

15 The prospective abnormal shadow detecting means may 

comprise a detection processing condition determining section 
which determines the detection processing conditions on the 
basis of the photographing conditions, and a prospective 
abnormal shadow detecting section which detects a prospective 

20 abnormal shadow through a predetermined detection processing 
on the basis of the radiation image data and the detection 
processing conditions determined by the detection processing 
condition determining section. 

The detection processing conditions are conditions 

25 which can affect the level of abnormal shadow which can be 
detected by the predetermined detection processing and include, 
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for instance, a threshold value and filtering properties of 
a shape -dependent filter employed in the detection processing. 

The shape -dependent filter is a matched filter formed 
according to geometric information on the micro calcification 
5 shadow such as the size and density distribution of the micro 
calcification shadow. A plurality of shape - dependent filters 
different in properties are generally prepared in advance 
according to properties of micro calcification shadows 
expected to appear in the radiation image. The 

10 shape -dependent filter may be formed each time the properties 
of the micro calcification shadow to be detected change. 

The predetermined detection processing may be any 
processing so long as the level of abnormal shadow which can 
be detected by the detection processing can be changed by 

15 changing the detection processing conditions and may be, for 
instance, processing for detecting a micro calcification 
shadow by morphology operation. 

The prospective abnormal shadow detecting means may 
comprise an image conversion section which carries out 

20 predetermined image conversion processing on the radiation 
image data on the basis of the photographing conditions, and 
a prospective abnormal shadow detecting section which detects 
a prospective abnormal shadow through a predetermined 
detection processing on the basis of the converted radiation 

25 image data. 

The image conversion processing may be, for instance, 
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frequency enhancement processing. 

The apparatus in accordance with the fifth aspect of the 
present invention is especially useful when the radiation 
image is a breast radiation image or when the abnormal shadow 
5 is a micro calcification shadow. 

Thus, in accordance with the present invention, the 
processing for detecting a prospective abnormal shadow is 
effected taking into account conditions which differ according 
to the patients and/or the radiation image, e.g., the prior 
10 information on the patient, the photographing conditions of 
the radiation image and the like. Accordingly, reliability 
of detection of a prospective abnormal shadow can be improved. 
Further, the result of detection is not affected by the 
skillfulness of the reader, whether the reader knows the prior 
15 information on the patient, and the photographing conditions. 
BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a schematic block diagram showing a 
prospective abnormal shadow detecting system in accordance 
with a first embodiment of the present invention, 
20 Figure 2 is a block diagram for illustrating a 

computer-aided radiation image diagnosis apparatus employing 
the prospective abnormal shadow detecting system shown in 
Figure 1, 

Figure 3 is a view showing an example of a mammogram 
25 represented by the image signal input into the computer-aided 
radiation image diagnosis apparatus shown in Figure 3, 
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Figure 4 is a schematic block diagram showing a 
prospective abnormal shadow detecting system in accordance 
with a second embodiment of the present invention, 

Figures 5A to 5D are views for illustrating the degree 
5 of convergence of density gradient vectors in a mammogram, 

Figure 6 is a view showing mask for calculating gradient 
vectors in the iris filter processing. 

Figure 7 is a view for illustrating the degree of 
convergence of gradient vectors for the pixel of current 
10 interest. 

Figure 8 is a view for illustrating an iris filter whose 
size and shape are changed to conform to the size and shape 
of the growth, 

Figures 9A to 9D are views for illustrating the 
15 morphology operation. 

Figure 10 is a view for illustrating a concept of a 
structural elements employed in the morphology operation, 

Figure 11 is a block diagram showing a prospective 
abnormal shadow detecting apparatus in accordance with a third 
20 embodiment of the present invention. 

Figure 12A is a view showing a mammogram including a 
typical micro calcification shadow, 

Figure 12B is a view showing a mammogram including an 
unsharp micro calcification shadow, 
25 Figure 13A and 13B are views illustrating calcification 

enhancement filters, 
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Figure 14A is a view showing signal values of an original 

image , 

Figure 14B is a view showing signal values of a micro 
structure image, 

5 Figure 14C is a view showing signal values of a 

calcification- enhanced image, and 

Figure 15 is a block diagram showing a prospective 
abnormal shadow detecting apparatus in accordance with a 
fourth embodiment of the present invention. 

10 DESCRIPTION OF THE PREFERRED EMBODIMENTS 

In Figure 2, a computer-aided radiation image diagnosis 
apparatus 60 is provided with a prospective abnormal shadow 
detecting system 10 in accordance with an embodiment of the 
present invention shown in Figure 1. The computer-aided 

15 radiation image diagnosis apparatus 60 comprises a memory 
means 20 which stores an input image signal S (will be referred 
to as "the overall image signal", hereinbelow) , an overall 
image processing means 3 0 which reads out the overall image 
signal S from the memory means 2 0 and carries out image 

20 processing such as gradation processing, frequency 
enhancement processing and the like on the overall image signal 
S, the prospective abnormal shadow detecting system 10 (shown 
in Figure 1) which reads out the overall image signal S from 
the memory means 20 and detects local image signals Sp and Sq 

25 representing prospective abnormal shadows Pp and Pq (Figure 
3) in the overall image signal S, a local image processing means 
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40 which carries out on the local image signals Sp and Sq image 
processing for enhancing the prospective abnormal shadows Pp 
and Pq represented by the local image signals Sp and Sq, and 
a display means 50 which displays as a visible image an overall 
5 image P represented by the processed overall image signal S' 
in combination with the prospective abnormal shadows Pp ' and 
Pq' represented by the processed local image signals Sp ' and 
Sq' . 

The overall image signal S input into the computer-aided 

10 radiation image diagnosis apparatus 60 is, for instance, an 
image signal (a high density, high level image signal) obtained 
by exposing a stimulable phosphor sheet, on which a breast 
radiation image of a patient (a mammogram P) such as shown in 
Figure 3 has been recorded, to stimulating light, 

15 photoelectrically detecting stimulated emission emitted from 
the stimulable phosphor sheet upon exposure to the stimulating 
light, and digitizing the analog image signal thus obtained. 

In this particular embodiment, the overall image P 
represented by the processed overall image signal S' is 

20 displayed by the display means 50 with the parts corresponding 
to the prospective abnormal shadows Pp and Pq replaced by the 
prospective abnormal shadows Pp ' and Pq' represented by the 
processed local image signal Sp ' and Sq' . However, the overall 
image P and the prospective abnormal shadows Pp ' and Pq' may 

25 be displayed in other various manners. For example, the 
overall image P as represented by the processed overall image 
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signal S' may be displayed at a part of one frame with the 
prospective abnormal shadows Pp ' and Pq ' as represented by the 
processed local image signal Sp ' and Sq' displayed at other 
parts of the frame. 
5 As shown in detail in Figure 1, the prospective abnormal 

shadow detecting system 10 of this embodiment comprises a 
prospective abnormal shadow detecting means 1 which carries 
out predetermined operation processing on the overall image 
signal S and compares the output value of the operation 

10 processing with threshold values T (i.e., threshold values Tl , 
T2 and T3 to be described later) , thereby detecting prospective 
abnormal shadows Pp and Pq in the radiation image P represented 
by the image signal S, a prior information input means 2 through 
which prior information SI on the object is input, and a 

15 detecting level changing means 3 which changes the prospective 
abnormal shadow detecting level at which the prospective 
abnormal shadow detecting means 1 detects a prospective 
abnormal shadow. 

In this particular embodiment, mammograms (the overall 

20 image) P obtained by breast cancer examination are read by the 
computer-aided radiation image diagnosis apparatus 6 0 shown 
in Figure 2, and in Figure 3, Pp represents a growth shadow 
of breast cancer and Pq represents a micro calcification shadow 
of breast cancer. 

25 The prospective abnormal shadow detecting means 1 

detects a prospective growth shadow Pp through the aforesaid 
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iris filter processing and subsequent comparison of the output 
value I of the iris filter processing with the threshold value 
Tl and detects a prospective micro calcification shadow Pq 
through the aforesaid morphology operation and subsequent 
processing with the threshold values T2 and T3 according to 
formula (17) . That is, when the output value I of the iris 
filter processing for a given part in the overall image P is 
larger than the threshold value Tl (I>T1), the prospective 
abnormal shadow detecting means 1 determines that the part is 
a prospective growth shadow Pp, and otherwise (i.e., when the 
output value I of the iris filter processing for the part is 
not larger than the threshold value Tl (iSSTI) , the prospective 
abnormal shadow detecting means 1 determines that the part is 
not a prospective growth shadow Pp. Further, when P(i, j) and 
M gra d for a given part obtained by the morphology operation (see 
the aforesaid formulae (15) and (16)) are not respectively 
smaller than the threshold values T2 and T3 , that is, when P(i, 
j) s^T2 and M gra d=T3 , the prospective abnormal shadow detecting 
means 1 determines that the part is a prospective micro 
calcification shadow Pq. Otherwise, the prospective abnormal 
shadow detecting means 1 determines that the part is not a 
prospective micro calcification shadow Pq. Accordingly, the 
prospective growth shadow detecting level can be changed by 
changing the threshold value Tl and the prospective micro 
calcification shadow detecting level can be changed by 
changing the threshold values T2 and T3 . 



The prior information input through the prior 
information input means 2 includes information obtained from 
meeting with the patient and/or examination by touch, the past 
history of the patient and the like. For example, when the 
patient has one or more persons who suffered from cancer or 
the like in his or her relatives, the detecting level changing 
means 3 reduces the threshold values Tl, T2 and T3 so that the 
detection probability of a prospective abnormal shadow is 
increased. When the patient was treated for tumor or the like, 
the disease is apt to return . Accordingly, the detecting level 
changing means 3 reduces the threshold values Tl, T2 and T3 
so that the detection probability of a prospective abnormal 
shadow is increased. When an induration has been found through 
examination by touch, the detecting level changing means 3 
reduces the threshold values Tl, T2 and T3 so that the detection 
probability of a prospective abnormal shadow is increased. 

Operation of the computer-aided radiation image 
diagnosis apparatus 60 will be described hereinbelow. 

When an overall image signal S representing a mammogram 
P is input into the apparatus 60, the overall image signal S 
is once stored in the memory means 20. Then the overall image 
processing means 30 reads out the overall image signal S from 
the memory means 2 0 and carries out image processing such as 
gradation processing, frequency enhancement processing and 
the like on the overall image signal S. The prospective 
abnormal shadow detecting system 10 also reads out the overall 



image signal S from the memory means 20. The overall image 
signal S is input into the prospective abnormal shadow 
detecting means 1 of the system 10. 

The prior information SI on the object is input into the 
5 prospective abnormal shadow detecting system 10 through the 
prior information input means 2. The prior information SI may 
be input from an electronic chart for the patient. 

The prior information SI input through the prior 
information input means 2 is transferred to the detecting level 
10 changing means 3 and the detecting level changing means 3 
changes the threshold values Tl, T2 and T3 stored in the 
prospective abnormal shadow detecting means 1 according to the 
contents of the prior information SI. 

The prospective abnormal shadow detecting means 1 
15 carries out on the overall image signal S read out from the 
memory means 20 the aforesaid iris filter processing and 
morphology operation processing and calculates output values 
I of the iris filter processing and output values P(i, j) and 
Mg ra d of the morphology operation for given parts. Then the 
2 0 prospective abnormal shadow detecting means 1 compares the 
output value I of the iris filter processing for each part with 
the threshold value Tl changed by the detecting level changing 
means 3 and compares the output values P(i, j) and M gra d of the 
morphology operation for each part with the threshold values 
25 T2 and T3 changed by the detecting level changing means 3 . When 
the output value I of the iris filter processing for the part 
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is larger than the threshold value Tl (I>T1) , the prospective 
abnormal shadow detecting means 1 determines that the part is 
a prospective growth shadow Pp, and otherwise (i.e., when the 
output value I of the iris filter processing for the part is 
5 not larger than the threshold value Tl (I^Tl) , the prospective 
abnormal shadow detecting means 1 determines that the part is 
not a prospective growth shadow Pp. Further, when P(i, j) and 
Mgrad for the part are not respectively smaller than the 
threshold values T2 and T3 , that is, when P(i, j ) is£T2 and M grad 

10 s£T3, the prospective abnormal shadow detecting means 1 
determines that the part is a prospective micro calcification 
shadow Pq. Otherwise, the prospective abnormal shadow 
detecting means 1 determines that the part is not a prospective 
micro calcification shadow Pq . 

15 The local image signals Sp and Sq detecting the 

prospective abnormal shadows detected by the prospective 
abnormal shadow detecting means 1 are input into the local image 
processing means 40. The local image processing means 40 
carries out on the local image signals Sp and Sq image 

20 processing for enhancing the prospective abnormal shadows Pp 
and Pq represented by the local image signals Sp and Sq, and 
outputs processed local image signals Sp ' and Sq'. 

The processed overall image signal S' processed by the 
overall image processing means 30 and the local image signals 

25 Sp and Sq processed by the local image processing means 40 are 
input into the display means 50. The display means 50 displays 
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the overall image P represented by the processed overall image 
signal S' with the parts corresponding to the prospective 
abnormal shadows Pp and Pq replaced by the prospective abnormal 
shadows Pp' and Pq' represented by the processed local image 
5 signal Sp ' and Sq' . 

As a result, the overall image P' together with the 
prospective abnormal shadows Pp ' and Pq ' enhanced more than 
the overall image P' is displayed and read by a reader, e.g., 
a doctor. Since the prospective abnormal shadows Pp' and Pq' 
10 are obtained by changing the detecting level according to the 
prior information on the object, the reader need not take into 
account the prior information when reading the radiation 
image . 

Though in the embodiment described above, the detecting 
15 level is changed by changing the threshold values Tl , T2 and 
T3, the detecting level may be changed in other various ways. 
For example, the detecting level may be changed by the size 
and/or the shape of structural elements employed in the 
morphology operation processing. 
2 0 Though in the embodiment described above, the detecting 

level is changed over the entire area of the mammogram P, the 
detecting level changing means 3 may be arranged to change the 
detecting level part by part of the mammogram P. For example, 
when the part where there is induration can be specified to 
25 some extent through, for instance, prior information obtained 
by examination by touch, the detecting level may be changed 
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only for a specified part of the image. With this arrangement, 
detection of a prospective abnormal shadow can be effected 
attaching greater importance to the specified part. 

Figure 4 shows a prospective abnormal shadow detecting 
5 system 10 ' in accordance with a second embodiment of the present 
invention. The prospective abnormal shadow detecting system 
10 ' of this embodiment differs from that of the first embodiment 
in that a photographing condition input means 2' through which 
the photographing conditions under which the mammogram P is 

10 taken, e.g., the tube voltage and/or current of the radiation 
source, the irradiating time, the mAs value, the degree of 
compression of the object breast, whether a grid is used, the 
kind of the grid used, the magnifying power and the like, are 
input is provided in place of the prior information input means 

15 2 and a detecting level changing means 3 ' which changes the 
detecting level according to the photographing conditions 
input through the photographing condition input means 2 ' is 
provided in place of the detecting level changing means 3 which 
changes the detecting level according to the prior 

20 information. 

With the prospective abnormal shadow detecting system 
10' of this embodiment, the prospective abnormal shadow can 
be surely detected even in a mammogram P which is obtained, 
for instance, with a small irradiation dose and accordingly 

25 in which a structure which is high in spatial frequency (e.g., 
a micro calcification shadow) is less apt to be detected since 
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the detecting level is changed so that the detection 
probability of a prospective abnormal shadow is increased 
according to the photographing conditions . Further the reader 
need not take into account the photographing conditions when 
5 reading the mammogram P. 

The prospective abnormal shadow detecting system 10' of 
this embodiment may be employed in the computer-aided 
radiation image diagnosis apparatus 60 shown in Figure 2 in 
place of the prospective abnormal shadow detecting system 10 

10 of the first embodiment. 

A prospective abnormal shadow detecting apparatus in 
accordance with a third embodiment of the present invention 
will be described with reference to Figure 11, hereinbelow. 

As shown in Figure 11, the prospective abnormal shadow 

15 detecting apparatus comprises a photographing condition input 
means 120 into which a radiation image taking means 110 for 
taking a radiation image of an object (breast) inputs 
photographing conditions, a detection processing condition 
determining section 130 which determines the detection 

20 processing conditions on the basis of the photographing 
conditions input into the photographing condition input means 
120, and a prospective abnormal shadow detecting section 140 
which receives the detection processing conditions and 
original image data P representing the radiation image of the 

25 object respectively from the detection processing condition 
determining section 130 and the radiation image taking means 
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110 and detects a prospective abnormal shadow in the radiation 
image on the basis of the radiation image data P and the 
detection processing conditions determined by the detection 
processing condition determining section 130. The detection 
5 processing condition determining section 130 and the 
prospective abnormal shadow detecting section 140 form a 
prospective abnormal shadow detecting means 160. 

The photographing conditions such as on the kind of the 
grid employed in photographing, the tube voltage, the filter, 
10 the irradiation dose, the pressure on the object, the thickness 
of the object under pressure, and the like are input into the 
photographing condition input means 12 0 manually by the 
operator or automatically from the radiation image taking 
means 110. 

15 In this particular embodiment, a micro calcification 

shadow is detected as the abnormal shadow. 

Operation of the prospective abnormal shadow detecting 
apparatus of this embodiment will be described hereinbelow. 

The photographing condition input means 120 inputs the 
20 pressure on the object into the detection processing condition 
detecting section 130. 

The detection processing condition detecting section 
130 determines the detection processing conditions on the 
basis of the pressure on the object input. 
25 The pressure on the object is a pressure under which the 

breast is pressed during radiography of the breast. It is said 
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that the pressure on the breast should be not smaller than 100N 
in order to obtain optimal radiation image data where a micro 
calcification shadow (Q ' ) is clearly shown as shown in Figure 
12A. However, such an optimal pressure sometimes cannot be 
5 obtained, and it is believed that, when the pressure is weak, 
an image in which the micro calcification shadow is thin (Q") 
as shown in Figure 12B (an image weak in contrast) is obtained. 
Accordingly, when the pressure is not higher than 100N, a 
calcification enhancement filter is employed according to the 
10 pressure. 

That is, the detection processing condition determining 
section 130 determines to use a first calcification 
enhancement filter such as shown in Figure 13A which is 
equivalent in properties to a thin micro calcification shadow 

15 when the pressure is not higher than SON, determines to use 
a second calcification enhancement filter such as shown in 
Figure 13B which is equivalent in properties to a typical micro 
calcification shadow when the pressure is higher than 50N and 
not higher than 100N, and determines to use no calcification 

2 0 enhancement filter when the pressure is higher than 100N. 

The calcification enhancement filter is a matched filter 
representing the size and density distribution of the micro 
calcification shadow as they are and a plurality of 
calcification enhancement filters having different properties 

25 optimized according to the properties of radiation images 
which fluctuate according to the photographing conditions are 
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prepared so that one of the filters is used according to the 
properties of the radiation image to be processed. 

The filters shown in Figures 13A and 13B are represented 
by the relation between the pixel positions in the main scanning 
5 direction and the sub- scanning direction and the density ratio 
(maximum density/density of the micro calcification shadow) . 
The first calcification filter shown in Figure 13A corresponds 
to properties of an unsharp micro calcification shadow and is 
relatively small (about 0.2) in the density ratio at the center 

10 of the calcification shadow and has a relatively large base 
(about 5 pixels X 5 pixels) . To the contrast, the second 
calcification filter shown in Figure 13B corresponds to 
properties of a typical micro calcification shadow and is 
relatively large (about 0.55) in the density ratio at the center 

15 of the calcification shadow and has a relatively small base 
(about 2 pixels X 2 pixels) . 

The calcification enhancement filter processing is 
carried out on a subtraction image obtained on the basis of 
the difference between the original image and a smoothened 

2 0 image obtained by carrying out smoothening processing by the 
morphology operation (the opening processing or the closing 
processing) on the original image. 

The prospective abnormal shadow detecting section 14 0 
detects a prospective abnormal shadow in the radiation image, 

25 represented by the original image data P input from the 
radiation image taking means 110, according to the detection 
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processing conditions determined by the detection processing 
condition determining section 130 . Detection of a prospective 
micro calcification shadow by morphology operation using 
preset threshold values with a calcification enhancement 
5 filter (a shape - dependent filter) used as the detection 
processing condition will be described here. 

The prospective abnormal shadow detecting section 140 
first obtains a micro structure image by carrying out the 
morphology operation processing on the original image data P. 

10 (The fundamentals of morphology operation) 

Though the morphology operation is generally developed 
as a set theory in a N- dimensional space, it will be discussed 
here on the basis of a two-dimensional tone image for the 
purpose of simplicity of understanding. 

15 It is assumed that a tone image is a space in which a 

point (x, y) has a height corresponding to a value of density 
f (x, y) . Further it is assumed that the value of density f (x, 
y) is represented by a high brightness, high level signal in 
which as the value of density decreases (the value of brightness 

20 increases when displayed on a CRT) , the level of the signal 
becomes higher. 

For the purpose of simplicity, a linear function f (x) 
corresponding to a cross - section of the image is first 
discussed. It is assumed that a structural element g employed 

25 in the morphology operation is a function which is represented 
by the following formula (18) , is symmetrical about the origin. 
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and is 0 in value in a domain represented by the following 
formula (19) . 
g'(x)-g(-x) (18) 

G={-m, -m + 1, -1, 0, 1, m-1, m) (19) 

5 At this time, the fundamental form of the morphology operation 
is very simple as shown in the following formulae (20) to (23) . 
dilation : [f G s ] (i) =max {f (i-m) , — , f (i) , , f (i+m) } ■•• (20) 
erosion : [f G s 3 (i) =min {f (i-m) , ■•■ , f (i) , — , f (i+m) } — (21) 
opening : f s =(f g s ) g (22) 

10 closing : f s =(f g s ) g (23) 

That is, the dilation processing is processing for 
searching a maximum value in the area whose width is +m (a 
value determined according to the structural element B) and 
whose center is at the pixel of current interest, see Figure 

15 9A, and the erosion processing is processing for searching a 
minimum value in the same area, see Figure 9B . The opening 
processing corresponds to searching a maximum value after 
searching a minimum value, and the closing processing 
corresponds to searching a minimum value after searching a 

2 0 maximum value. In other words, the opening processing 
smoothens the density curve f (x) from the low brightness side 
by removing protrusions in density (the portions which are 
higher in brightness than the surroundings) which are narrower 
than the mask size 2m (see Figure 9C) , whereas the closing 

25 processing smoothens the density curve f (x) from the high 
brightness side by removing recesses in density (the portions 
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which are lower in brightness than the surroundings) which are 
narrower than the mask size 2m (see Figure 9D) . 

In the case of a high density, high level signal in which 
as the value of density increases, the level of the signal 
5 becomes higher, the value of image signal for the value of 
density f (x) is reverse to that of a high brightness, high level 
signal. Accordingly, the dilation processing for a high 
density, high level signal corresponds to the erosion 
processing for a high brightness, high level signal. 

10 Similarly, the erosion processing for a high density, high 
level signal corresponds to the dilation processing for a high 
brightness, high level signal, the opening processing for a 
high density, high level signal corresponds to the closing 
processing for a high brightness, high level signal, and the 

15 closing processing for a high density, high level signal 
corresponds to the opening processing for a high brightness, 
high level signal . Description will be made only on the high 
brightness, high level signal here. 

(Application to detection of a calcification shadow) 
20 As a method of detecting a calcification shadow, a 

subtraction method in which a smoothened image is subtracted 
from an original image is conceivable. Since it is difficult 
to distinguish a calcification shadow from an elongated 
non-calcification shadow (e.g., of a mammary gland, a blood 
25 vessel, and a mammary gland supporting tissue) by a simple 
smoothening method, Obata, et al , have proposed morphology 
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operation processing based on opening operation using multiple 

structural elements as represented by the following formula 
(24) . See "Extraction of Micro Calcification Shadow by a 

Morphology Filter using multiple Structural Elements" 
5 (Journal of Academy of Electronics/Information/Communication 

D-II, vol. J75-D-II No. 7, ppll70 to 1176, Jul. 1992) and 
"Fundamentals of Morphology and its Application to Mammogram" 
(MEDICAL IMAGING TECHNOLOGY, Vol. 12, No . 1 January 1994) 

P=f- max {(f0Bi)©Bil 

i e (1, ■•• , M) 

10 (24) 

= f- max {f Bi } 

i e d, -, m 

wherein Bi (i stands for 1, 2, 3 and 4) are four linear 
structural elements B shown in Figure 10. When the structural 
elements B are larger than the calcification shadow to be 

15 detected, calcification shadows which are signal protrusions 
narrower than the structural elements B (a part of image the 
image signal of which fluctuates in a range spatially narrower 
than the structural elements B) are removed by opening 
processing. On the other hand, an elongated non- calcification 

20 shadow is left there as it is after the opening processing 
(calculation of the second term in formula 14) so long as it 
is longer than the structural elements B and its inclination 
(the direction in which the shadow extends) conforms to any 
one of the four structural elements Bi . Accordingly, by 

2 5 subtracting the smoothened image (the image removed with the 
calcification shadow) obtained by the opening processing from 
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the original image f_, an image containing therein only a small 
prospective calcification shadow is obtained. This the 
concept of formula (24) . 

In the case of a high density, high level signal, closing 
5 processing is applied according to the following formula (15) 
in place of opening processing. 

P=f- min {(f©Bi)0Bi} 

i e (1, -.11) 

(25) 

= f- min {f Bj) 

i G (1, ••• , M) 

10 The image obtained according to formula (24) or (25) , 

that is, the subtraction image obtained on the basis of the 
difference between the original image and a smoothened image 
obtained by removing a calcification shadow from the original 
image, is the micro structure image. See Figure 14B. Figure 

15 14A shows the original image. 

Then the prospective abnormal shadow detecting section 
140 processes the micro structural image with the 
calcification enhancement filter determined by the detection 
processing condition determining section 130, thereby 

20 specifically enhancing a micro calcification shadow on the 
micro structural image having properties equivalent to the 
calcification enhancement filter. See Figure 14C. When the 
detection processing condition determining section 130 
determines that no calcification enhancement filter is used, 

25 the calcification enhancement processing is not carried out. 

Then the prospective abnormal shadow detecting section 
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140 carries out on the resultant image the same threshold 
processing as the conventional processing and detects a 
prospective calcification shadow. 

That is, non- calcification shadows contained in P of 
5 formula (24) are further removed by the use of differential 
information based on a morphology operation according to the 
following formula (26) . 
M grad = (1/2) X {f A B- f AB} (26) 

As the value of M gra ci increases, the probability that the shadow 
10 is of a calcification increases. Accordingly, a prospective 

calcification shadow C s can be obtained according to the 

following formula (27) . 

If P(i, j)^T2, and M grad (i, j) ^T3 

Then, C s (i, j ) =P else C s (i, j)=0 (27) 
15 T2 and T3 are empirically determined threshold values. 

Since a non - calcification shadow different from a 

calcification shadow in size can be removed only by comparison 

of P obtained according to formula (24) and the threshold value 

T2 , only the condition of the first term of formula (27) , P(i, 
20 j) ^T2 has to be satisfied in the case where there is no 

possibility that a non-calcification shadow equivalent to a 

calcification shadow in size remains. 

Finally, the cluster Cc of the calcification shadow is 

detected by a combination of a multi- scale opening operation 
25 and closing operation represented by the following formula 

(28) . 
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C C = C S A X B A 3 B A 2 B (28) 
Aj and A 2 are respectively determined by the maximum distance 
between calcification shadows to be fused and the maximum 
radius of an isolated shadow to be removed, and A 3 =A 1 +A 2 . 
5 Though, in the third embodiment described above, a 

calcification enhancement filter is used as the detection 
processing condition, the threshold values T 2 and T 3 may be 
changed according to the photographing conditions input in 
place of using such a calcification enhancement filter. 

10 Further, though in the third embodiment described above, 

the pressure on the object is employed as the photographing 
condition, other various photographing conditions may be 
employed as the photographing condition and the detection 
processing condition may be determined to conform to the 

15 photographing condition. 

For example, when "the thickness to which the breast is 
compressed" is large, the calcification shadow can become 
unsharp and accordingly, it is preferred that different 
calcification enhancement filters be used depending on the 

20 thickness to which the breast is compressed. 

When the irradiation dose is small, more noise is 
contained in the image data and it is difficult to separate 
the noise from the calcification shadow. In this case, the 
calcification enhancement processing with a calcification 

25 enhancement filter is not carried out and the threshold values 
T2 and T3 are increased not to detect excessive noise. 
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The filter is a plate of aluminum, molybdenum or the like 
for controlling the quality of radiation. When a filter of 
a material other than molybdenum is used, the radiation image 
can deteriorates in contrast and accordingly, it is preferred 
5 that the calcification enhancement processing be carried out 
by the use of the first calcification enhancement filter 
corresponding to an unsharp micro calcification shadow. 

When the tube voltage is higher than 30kV, the radiation 
image can deteriorates in contrast and accordingly, it is 

10 preferred that the calcification enhancement processing be 
carried out by the use of the first calcification enhancement 
filter corresponding to an unsharp micro calcification shadow. 

The "kind of the grid" means the kind of the grid mounted 
on the X-ray apparatus. When an HTC grid formed of tantalum 

15 and air is employed, the image is apt to be extraordinarily 
high in contrast as compared with when a typical grid formed 
of lead and aluminum is employed. Accordingly, when an HTC 
grid is employed, the values of the threshold values employed 
in the calcification detection processing are increased by 

20 adding, for instance, 0.50 to the standard threshold values. 
Since the value, 0.50, was empirically determined on the basis 
of 10 bit images , the value to be added to the standard threshold 
values need not be limited to 0.50. 

Generally, the abnormal shadow detecting level can 

25 largely differ between when a grid formed with air employed 
as a part of the material is employed and when a grid formed 
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without air employed as a part of the material (a material other 
than air absorbing the radiation is employed in place of air) 
is employed. Accordingly, when a grid formed with air employed 
as a part of the material is employed, it is preferred that 
5 the detection processing conditions be changed. 

The detection processing conditions may be changed according 
to other various photographing conditions which can affect the 
result of detection. Further, the detection processing 
conditions, e.g., the properties of the calcification 

10 enhancement filter, the threshold values T2 and T3 , and the 
like, may be changed in various ways according to the 
photographing conditions employed. 

A prospective abnormal shadow detecting apparatus in 
accordance with a fourth embodiment of the present invention 

15 will be described with reference to Figure 15, hereinbelow. 
In Figure 15, the elements analogous to those shown in Figure 
11 are given the same reference numerals and will not be 
described in detail here. 

As shown in Figure 15, the prospective abnormal shadow 

2 0 detecting apparatus of this embodiment comprises a 
photographing condition input means 120 into which a radiation 
image taking means 110 for taking a radiation image of an object 
(breast) inputs photographing conditions, an image conversion 
section 150 which carries out predetermined image conversion 

25 processing on the radiation image data P input from the 
radiation image taking means 110 on the basis of the 
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photographing conditions input into the photographing 
condition input means 12 0, thereby obtaining converted 
radiation image data P', and a prospective abnormal shadow 
detecting section 140 which receives the converted radiation 
5 image data P' from the image conversion section 150 and detects 
a prospective abnormal shadow in the radiation image on the 
basis of the converted radiation image data P'. The image 
conversion section 150 and the prospective abnormal shadow 
detecting section 14 0 form a prospective abnormal shadow 

10 detecting means 160. 

Operation of the prospective abnormal shadow detecting 
apparatus of this embodiment will be described hereinbelow. 

The image conversion section 150 carries out on the 
original radiation image data P image conversion processing 

15 selected according to the photographing conditions input into 
the photographing condition input means 12 0, thereby obtaining 
a converted radiation image data P ' . For example, the pressure 
on the object is lower than a predetermined value, the image 
conversion section 150 carries out high frequency enhancement 

20 processing on the original radiation image data P, thereby 
obtaining high-frequency enhanced radiation image data P'. 

Then the prospective abnormal shadow detecting section 
140 carries out on the high-frequency enhanced radiation image 
data P' the same processing as the conventional processing and 

25 detects a prospective calcification shadow. That is, the 
prospective abnormal shadow detecting section 140 carries out 
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on the high-frequency enhanced radiation image data P' 
smoothening processing by morphology operation as in the third 
embodiment, thereby obtaining a micro structure image. Then 
the prospective abnormal shadow detecting section 140 further 
5 removes the non- calcification image from the micro structure 
image and detects a prospective calcification shadow by the 
use of the threshold values T2 and T3 . 

Though, in the embodiments described above, a micro 
calcification shadow is detected by morphology operation, 
10 other abnormal shadows may be detected in accordance with the 
present invention. 

Further, the present invention may be applied not only 
to a mammogram but also to other various radiation images such 
as a chest radiograph. 

15 
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